Labels:text | screenshot | font | information OCR: H(X) == >p(X=s)log,p(X=s) Figure 1: Shannon's formula. S is the sel of all possible symbols, p(X=s) is the probability that a particular symbol will occur. H(X) is the total entropy of a data source X.